STABILITY OF LINEAR FLOCKS ON A RING ROAD 
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Abstract. We discuss some stability problems when each agent of a linear flock in R interacts 
with its two nearest neighbors (one on either side). 
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1. Introduction 

A flock consists of a large number of moving physical objects, called agents, with their po- 
sitions being controlled in such a way that they move along a prescribed path, in a prescribed 
and fixed configuration (or in formation). Each agent knows the position and velocity of only a 
few other agents, and this flux of information defines a communication graph. 

In [5] graph theory and linear systems techniques are combined to provide a framework for 
studying the control of formations. The main tools of graph theory that are related to the 
problem are the directed graph Laplacians and the connectedness of the graph. Linear feedback 
is then used to stabilize the patterns. 

More recently [6] studied a system of coupled linear differential equations describing the 
movement of cars in R, where each car reacts only to its immediate neighbors, and only the 
movement of the first agent (the leader) is independent from the rest of the group. In the paper 
it was proved that When equal attention is paid to both neighbors perturbations in the orbit of 
the leader grow as they propagate through the flock. In fact, perturbations grow proportional 
to size of the flock: when the leader's perturbation has amplitude 1, then the perturbation in 
\ the orbit of the agent furthest away from the leader will be proportional to N (the size of the 

flock). 

The aim of this paper is first of all to study the (asymptotic) stability of a family of such 
systems. This is answered in detail in Theorems 13.21 and 13.31 Next we assume the flock has a 
leader that chooses its orbit independently of the other members of the flock. We then analyze 
how exactly the system converges to a stable flight pattern if the leader changes its orbit. This 
question only makes sense when the system is already asymptotically stable, which is therefore 
assumed henceforth. The latter question is important in applications as too great fluctuations 
in the course of convergence to a coherent flight pattern will make that flock unviable. 

In all of these arguments we closely follow the reasoning set forth in previous works [7, 8, 9J. 
However there are two important differences. The first is that the farthest member of the 
flock (in this work) is coupled to the leader. In the language of partial differential equations, 
this is akin to changing a boundary condition. The reason is twofold. Changing the boundary 
condition can greatly aid the mathematics, and therefore help to gain insight. The second reason 
is a deeper one: we do not know how these boundary condition influence the stability of these 
systems, and thus this note can be viewed a test case (when compared with the papers just 
cited). The other difference with the previous papers is that we here allow the weight of the 
coupling with neighbors to be negative. While at first glance this seems a little odd, there is a 
good reason to do so, if one hopes to study systems with more than nearest neighbor coupling. 
Suppose for example that one models local interaction as a discretization of a fourth derivative, 
a very natural idea. However the couplings to the first and second nearest neighbors will now 
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have different signs. This goes against the grain of what one knows about Laplacian systems 
in general, where in general all couplings must have the same sign (see PQ). In this case we 
managed to overcome that problem and analyze stability also when the signs of the (nearest 
neighbor) interactions are different. (By necessity they must add up to 1.) 

The outline of this paper is as follows. In the next section we start by specifying the model. 
Next we discuss the asymptotic stability of the model. Following [8] we introduce two other 
types of stability for flocks. These describe the effect of perturbations in the leaders motion on 
the outlying members of the flocks. A flock with A^ agents is harmonically stable if the effect 
of a harmonic motion of the leader on the outlying members grows less than exponentially fast 
in A' (everything else held fixed). A flock is said to be impulse stable if the effect of the leader 
being kicked is less than exponential on the outlying members. Thus is section 4, we discuss 
harmonic stability of the model. The problem of impulse stability is still unsolved. We present 
a few comments on that problem in section 5. (The appendix contains technical results and is 
included for completeness.) 

2. The model 

We begin this section establishing the model of this work. The N + 1 agents move in R along 
orbits Xi(t), i £ {0, • • • n}, with velocities x'^t). When they are moving in the desired formation 
their velocities are equal and their relative positions are determined by A^ + 1 a priori given 
constants hi'. 

(2.1) Xj — Xi = hj — hi 

We write the equation of motion for this model in terms of 

(2.2) Zi = Xi-hi . 
These then have the following form: 

(2.3) Zi = f {zi - (1 - - pzi+i} + g - (1 - p)h-i ~ pzi+i} , 
for all % = 1, . . . , N, and 

(2.4) z N+1 {t) = z (t) , 

a priori given. We will assume the feedback parameters f, g are negative reals and the weight 
p is a arbitrary real number. 

It is intuitively convenient, though not necessary, to keep a particular realization of the above 
system in mind. Identify x = N + 1 with x = 0, so that the agents move on a (topological) circle. 
Suppose further that the offsets hi are given by hi = —i mod N. Now the desired configuration 
is that of A~ + 1 agents moving at constant speed and uniformly distributed along a circle. (This 
explains our title.) 

Our strategy here is primarily studying qualitative aspects of the solution of (j2.3j) - ()2.4[) as we 
let N tend to infinity while keeping all other parameters (p, /, and g) fixed. In particular we 
wish to understand (1) when the system is asymptotically stable and (2) how does it converge 
to its equilibrium when it is asymptotically stable. This stable equilibrium is given by the two 
parameter family of orbits: 

z k (t) = z (0)+v (0)t 

and 

z k (t) = v (0) • 

These orbits are called information orbits (for a more detailed discussion, cf. El El E])- 
It is advantageous to write (|2.3|) - (|2.4p in a more compact form: 

Z= (Z1,ZI,Z2,Z 2 ,--- ,Z N ,Zn)- 

The system can now be recast as a first order ordinary differential equation: 

(2.5) z = Mz + T (t) . 
The matrix M and the vector Tq are defined below. 
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the matrix P defined by 

(2.7) P = I-Q„, 

where / is the ^-dimensional identity matrix, is called the reduced graph Laplacian. It describes 
the flow of information among the agents, with the exception of the leader (hence the word 
'reduced'). 

The orbit of the leader is assumed to be beforehand given and therefore only appears in the 
forcing term To(t). We will refer to this agent as an independent leader. Analyzing (|2.3p - (|2.4p 
and assuming without loss of generality that ho = 0, one gathers that: 

/ \ 

(l-p)(fz (t)+gz (t)) 




(2.t 



r (i) 







V p(fzo(t) + gz {t)) J 
In order to define M matrix of f)2.5[) in terms of these quantities, we use the Kronecker product, 



M = I <g> A + P <g> K , 



where A and K the 2x2 matrices: 

1 




A 



and K 
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The advantage of this somewhat roundabout way of defining the matrix M is that in the 
eigenvalues of the reduced Laplacian P can be given explicitly. From that the eigenvalues of M 
can then be derived. 

3. Asymptotic Stability 

The system defined in (|2.3j) - f)2.4|) is called asymptotically stable if all eigenvalues of M have 
negative real part. Assuming the Vq{€) = 0, for t > to, the solution of the system tends to 
exponentially fast (in t) if and only if the system is asymptotically stable. This corresponds to 
the classical notion of asymptotic stability. 

The study of the eigenvalues of the N x N matrix Q p defined in (|2.6p constitutes a special 
case of results given in [21 [3]. They are given by: 



V(i-p)p 



COS 



for^= 1,2, 



N. 



N + l 

for all real p. These eigenvalues are all real if and only if p G [0, 1] and imaginary otherwise, and 
the locus of the set of eigenvalues is invariant under multiplication by —1. We have: 

Proposition 3.1. The reduced Laplacian P has eigenvalues \g = 1 — 2\J (1 — p)p cos , 
for I = 1,2, ... ,N, for all real values of p. 

One can show that the eigenvalues of M = I®A + P®K are the solutions U£± of the equation 
(3.1) u 2 -X e gu-X £ f = , 

where Xe runs through the spectrum of P (cf. [H El El [7]). So we have: 
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Theorem 3.2. (1) The eigenvalues of M are 

vi± = 2 ( x e9 ± V(^eg) 2 + 4X e f 

where Xg runs through the spectrum of P. 
(2) For p G [0,1], all real numbers Xe are contained in the interval [0,2], and the system is 
asymptotically stable if and only if both f and g are strictly smaller than zero. 

These expressions are the same as the corresponding ones for a sightly differnt one dimensional 
flock given in [8J. There it was assumed that p G [0, 1). We extend that research by looking at 
real values of p outside the interval [0, 1]. This may at first seem obscure. Here however is the 
motivation. Suppose for a moment that one allows each agent to interact with two neighbors on 
either side, then one could be tempted to model this interaction as a discretization of a fourth 
derivative in the spatial variable. In that case some of the weights of the interaction would have 
negative values. 

Theorem 3.3. Let p G R\[0, 1]. For a given f and g, the system defined in H2.3\ )- (K4\ ) is 
asymptotically stable, for an arbitrary N, if and only if both of the following hold: 

(1) / and g are negative, and 

(2) / + g 2 > or else 4|p(l - p )\<j^. 

Proof. When p(l — p) is negative, the eigenvalues Xi of P satisfy Xi = 1 + iai, where ai as- 
sumes the values —2^1^(1 — p)\ cos j^j- In particular, for an N sufficiently large, the a/s will 
distribute themselves smoothly in the interval 



(3-2) l- 2 ^\p(l-p)\, + 2y/\p(l-p)\ 



We need to prove that eigenvalues of M (provided by (|3.ip ) have negative real part. We first 
look at eigenvalues that correspond to an approaching to 0. By continuity we may set ai = 0. 
We get 

g± y/gTg 
± 2 

These roots are real and have opposite signs if / is positive and have the same sign as g if / is 
negative. This proves that for ai small enough the corresponding eigenvalues of M have negative 
real part if and only if / and g are negative. 

It remains to check for what values of a the real part of V- or v + can become greater than 
or equal to (cf. Figure [3TT]) . To that end we set u = ir, with r real. The real and imaginary 
part of the equation ()3. 1 j) now become (abbreviating to a): 

T 2 -gar + f = 
fa+gr = 

The first equation defines a hyperbola in the (a, t) plane, and the second equation a line through 
the origin. Real solutions for a and r exist if and only if / + g 2 < and are given by 

( T ' a ) = / t 1 ? ' ~3) ■ 



Such solutions exist for some a smaller than 2^/\p(l — p)\ (see interval ()3.2[) ) if and only if in 
addition 

-g 



2y/\p{\-p)\> 



Finally, if / + g 2 < and 2-v/|p(l — p)\ > a > , 9 , we prove that the system has eigen- 

V-f-Sr 

values with positive real part. By continuity, it is sufficient to prove this only for a arbitrarily 



STABILITY OF LINEAR FLOCKS ON A RING ROAD 



5 




Figure 3.1. The calculation of v± as function of a for f = —5 and g = —1, a 
ranging from to 5. Notice that ^±(0) = 0.5(— 1 ±i\/l9); at a = 0.5, i/_ crosses 
the imaginary axis. 

large. In that case Theorem 13.21 (1) gives: 



(3.3) + + . 

From equation (|3.ip we deduce that Re (u + ) + Re (f_) = Re (g(l + id)) = g. Thus as a tends to 

/ 

9 

4. Harmonic Stability 



infinity, Re (v+f) = g + - > 0, which was to be proved. □ 



The system is harmonically unstable roughly if oscillatory or harmonic perturbations in the 
orbit of the leader (that is: of the form e lu)t ) have their amplitude magnified by a factor that is 
exponentially large in iV (cf. [8]). 

We first need some notation. It will often be convenient to replace p by a different constant: 

I-P 



or, equivalently, 



P 
1 



1 + 



We also define (for p ^ 0) : 

(4.1) fl± = ±( 1 ± ^/ 7 2 _ 4 p(l - pj) 



where 



2p 

f + iu g + iJ 1 

1- 



f + iug 

Proposition 4.1. The frequency response function of the k-th agent is given by 

a k {f,g,uj) = N _ N ' 
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where p± is defined as in h4.1\ ). 

Proof. All eigenvalues of M have negative real part. Let zo(t) be given by e lU}t . Under these 
assumptions, the motion of the system is asymptotic (as t — > oo) to z k = a k e tLut . This leads to 
a recursive equation on a*., for k = 1, . . . , N, 

(1 - P) dk-i -ja k +p a k+ i = . 

The boundary conditions are given by: 

a = <iN+i = 1 • 

Let p± be the roots of the associated characteristic polynomial 

Tjt \ 2 7, \-p 
r\x) = x x H . 

P P 

The general solution is 

a k = c_// + c+p k + . 

A convenient way to solve for c± is by setting d\ = c_/i^ and c?2 = c+/x^. The boundary 
conditions can be rewritten as 

1 1 \ / c_ \ / 1 



P N + +1 )\c + ) VI 



or, equivalently, 

( C + ) = _ ^N+l V 1-^+1 

Substituting this into a k and using the fact that the product of the p,± equals k, we get the 
result. □ 

We will assume here without further proof that fluctuations of the leader that are propagated 
through the system are largest for the agents furthest away from the leader, i.e. halfway in the 
flock. For simplicity we only consider in this section the response of the agent k = where 
iV is odd (and large). 

Corollary 4.2. If N is odd, we have for M = ^p-: 

(k m + 1) 



where fi± is defined as in l[4-l\)- 



a M (f,g,u)- M M 
P- i P+ 



Recall that by Theorems 13.21 and 13 . 31 the system is asymptotically stable if and only if p 6 [0, 1] 
and / and g negative or else p E M\[0, 1] and both of the following hold: 

• / and g are negative, and 

• / + 9 2 > or else 4|p(l - p)\ < f^. 

Recall from the proof of Theorem 14 . 1 1 that if Zo(t) equals e lujt then z k is asymptotic to a k e lU}t . 
Thus the amplification at the fc-th agent of the leader's signal is given a k {oo). We need to 
determine whether maxj. sup w |afc(a;))| is exponential in N (instability) or less than exponential 
(stability). We may assume k = M. So let 

A M = sup \a M (iu)\ ■ 

Following [8], we call a system harmonically stable if it is asymptotically stable and if 

limsup I^U/j 1 ^ < 1- 

M->oo 



Theorem 4.3. The system given by the equation \2. 5\) is harmonically stable if and only if 
p = 1/2 and f and g are negative. 
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Figure 4.1. The eigenvalues p+(oj) (blue) and p~(cu) (red) when f = g 
and p = 1/2, for u positive. In addition the unit circle is drawn in green. 



a M (u) = j M M and = 1 



Proof. We concentrate first on the p = 1/2 case. Here we have: 

2 

p + {u)M~ p_^y 

Geometrically what happens is that the system exhibits near-resonance. More precisely, the 
curves p±{oo) are (quadratically) tangent to the unit circle at u = (see Figure l4TTj) . Of course 
when p±(oj) = e ±ln / 2M the denominator cancels and om is undefined. The quadratic tangency 
means that (for M large) the curves p±(oS) pass the points e =ti7r / 2M on the unit circle at a 
distance proportional to 1/M. In turn this means that 

A M = sup \a M (u))\ 

grows linearly in M and is thus harmonically stable. 

Analytically this can be worked out precisely by doing a pole expansion on clm (w). A very 
similar calculation was done in detail in [7] and we will not repeat that calculation here. The 
only differences with that calculation are: here we are calculating a a/ and not o^v, and here our 
eigenvalues i/£± are slightly different from those in the cited paper. 

Now we turn to the other cases: p ^ 1/2. We first argue that the cases p and 1 — p are 
symmetric. In particular if we use a new value p' = 1 — p instead of p, then in the expression for 
oa/, p± and k are all replaced by their reciprocals as can be seen by inspecting the polynomial 
P in the proof of Proposition 14.11 A little calculation shows that au is invariant under this 
operation. It is thus sufficient to consider only p < 1/2. 

Proposition 16.31 tells us that for all p < 1/2 there is no resonance or near resonance as the two 
p have distinct modulus. Lemma 16.41 implies that, for u> less than some u+ given there, P-(oj) 
is bigger than 1. Since in this case \k\ > 1 and p+p- = k, we have for to G (0,a;+): 

N > Iam-MI > Im-(^)I > 

and thus the expression in the above Corollary grows exponentially in M . Therefore all these 
systems are harmonically unstable. □ 

5. AN OPEN PROBLEM 

Suppose now that the flock is in a stable equilibrium (i.e. moves stably in formation) when the 
leader suddenly and quickly changes its velocity. Roughly speaking we call the system impulse 
stable when the physical response of the other agents (i.e., the acceleration, or the velocity, or 
the position) is less than exponential in M. As observed in the proof of Theorem 14.31 the case 
p = h is extremely similar to the problem studied in [7], and the solution is in fact similar to 
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the one given in that case. The calculations there indicate responses that are 'proportional' to 
M. Thus may we conclude that here also: 

Proposition 5.1. The system given in the equation \2. 5\) is impulse stable when it is asymp- 
totically stable and when p = 1/2. 

The cases p 7^ 1/2 lead to problems similar to the one that remained unsolved in [S]. It seems 
very likely at this point that most of these cases are impulse unstable, though this is by no means 
obvious or known. More specifically, as we vary /, g and p ^ 1/2, we do not even qualitatively 
understand the large N behavior of the motion of these flocks. This question is relevant because 
velocity changes of the leader are a natural context in which stability plays an important role for 
the cohesion of the flock. We might think for example of a lead car accelerating when a traffic 
light turns green or a large flock of animals changing course because outlying members spotted 
and try evade a predator. 

The mathematical problem boils down to an inverse Fourier transform of om(w) where M is 
large. Current standard integration techniques do not readily give asymptotic (in M) expressions 
for such integrals. We do not address this challenging question any further here, leaving it as 
an open problem for future research. 

6. APPENDIX: Technical Results 

In this section we gather some technical results which we exhibited partially before in [8]. 
The results there were proved only for p £ [0,1]. Some of the calculations extend verbatim 
(or almost) to all pel, The proof of the main result, Proposition 16. 3\ had to be modified 
substantially however. 

Lemma 6.1. Let u > be sufficiently small. 
(1) For p £ (0, \), we have: 



and 



{J 1 . Isio; 3 



P- = 1 " 7^1 TTTFi + * ml + °^ 



(2p- 1)|/| (2p-l)/ 
(2) For p G (g, 1), we have 

uj 2 \g\u 3 4 

and 

= — I 1 + w^w\ - ' w^w) + ° ( " ' • 

Proof. By sheer calculation. (See [6] for some of the computational details.) □ 
Remark 6.1. This expansion diverges for p = 1/2; in that case we have (cf. [S]): 

Lemma 6.2. 

7(W) = 1 " To I ,00 + » 



f 2 + uj 2 g 2 f 2 + u 2 g 2 ' 

The complicated looking conditions in the following proposition are nothing but the conditions 
that insure asymptotic stability (see Theorems 13.21 and I3.3|) . 

Proposition 6.3. Let p £ [0, 1] and f and g negative or let p G M\[0, 1] and suppose that both 
of the following hold: 
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i: / and g are negative, and 
ii: / + g 2 > or else 4|p(l - p )\<j^. 
Then, r defined by 



sup- 



exists and is contained in interval (0, 1) with only two exceptions: 

• when p = \, |^(^)| e^a/s 1 at uj = and is is strictly smaller than 1 for uj > 0, or 

• when 4p(l — p) = J® g 2 < < 0, n^fejj *s strictly smaller than 1, if > uj 2 < _j_ g i > 
and |//-(a;)| = «/^ 2 = ■ 




Figure 6.1. The constant k = (1 — p)/p as function of p. 



Proof. It is clear from remark [6.11 that when p = \ the two eigenvalues are equal to 1, when 
uj = 0, and so at that point the quotient equals 1. The arguments below establish that the 
quotient is always smaller than 1, for all positive values of uj. As far as the second exception is 
concerned: We will show that the equality of /i+ and p- occurs at some uj > 0. The arguments 
below, however, insure that for smaller (non-negative) values of uj, the modulus of the quotient 
of the eigenvalues is strictly smaller than 1. 

From its definition, 7(0;) ~ j- when uj is large. Substitute this into the expression for p± 

in equation (|4.ip to see that for a large enough uj, in fact, f4I becomes very small. In the 

following, note that \k\ > 1 if and only if p < \ and \k\ > 1 if and only if p > 5 (see Figure UTTj) . 

So when uj = 0, Lemma 16 . 1 1 implies that 1^4 equals min{|«:|, for all p. 

It is now sufficient to prove that, for uj 6 R + , the absolute values \p±\ are never equal. So 
suppose there are ujq and 9 G E such that p + (ujq) — p-(uJo)e l9 = 0. The definition of p± in 
equation (|4.ip provides: 

7(1 - e ie ) = -Vf-Ml-pKl + e w ) . 



Dividing this by 1 + e l6 ', squaring the equation, and noting that 

- tan 2 



we get 



(1 - e iB ) 2 
(1 + e i6 ) 2 " 

7 2 (1 + tan 2 ) = 4p(l - p) . 



10 



J.J.P. VEERMAN AND CM. DA FONSECA 



If p(l — p) > 0, then 7 2 is a positive real number and therefore 7 is real for some which 
is impossible by Lemma 16.21 If p(l — p) < 0, then 7 2 is a negative real number so that 7 is 
imaginary. Setting the real part of 7 equal to in Lemma 16.21 yields f 2 + co 2 (f + g 2 ) = 0. If 
/ + g 2 is non- negative, this has no solution (because ui is real). So suppose it is positive. Then 
substitute the positive solution into 7 and check that 7 = i , ^ Substituting this in turn 

into (|4.ip . we see that the modulus of /u + is greater than that of p- (here ^f- means the root 

2 2 
in the upper half plane) as long as 4|/?(1 — /?)| < ^_ g g2 . When 41/9(1 — p)| = 2 , we have 

/i+ = □ 




Figure 6.2. An illustration of the curious behavior of p±(uj). The eigenvalues 
p+{oj) are in blue and P-(uj) are in red, when f = — 5 and g = —1, for positive 
oj. The circle r = k (green), r = ^/\k\ (yellow), and the unit circle (black) 
are also drawn. Note that p+(0) = k (which is negative in both cases) and that 
p~(0) = 1. In the first figure p = —0.05 and pu U e is always bigger than p Te d 
except MAPLE insisted in using the principal root for the square root as opposed 

to our convention, and so it recklessly swaps the 2 roots. In the second picture 

2 

4p(l — p) > j+jp < (while p(l — p) < 0) and now the quotient of the two roots 
crosses 1. 

Lemma 6.4. For each p < 1/2, there is a unique uo+ > such that 

u) G (0,u + ) implies |/x_(w)| > 1 

and 

oj > bj + implies \p-(oo)\ < 1 . 
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Proof. We know that /U_(0) = 1 and, from the proof of the previous lemma, for a large uj, 
is small. It is sufficient to prove that uj + is the unique solution in (0, oo) of = 1 

and that it is simple. 

In fact, consider the characteristic equation p p 2 — 7 p + (1 — p) = and suppose that there 
is a root p = e ld . Then 

7 = pe* + (1 - p) e -' w = cos(#) + i(2p - 1) sin(0) . 

Equating this to the expression given in Lemma 16.21 and using the Pythagorean trigonometric 
identity, we to obtain: 

This equation factors as follows: 

- 2 (j2~Yf°° A + (/2 " 2|/|5V " 2|/|3 ) = ° 

The second factor is a quadratic expression in uj 2 which has a positive leading coefficient and a 
negative trailing coefficient. This gives exactly one simple positive root for uj 2 , yielding a unique 
simple positive root ui = uj + . □ 

Remark 6.2. In fact, 
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